Barabasi Queueing Model and Invasion Percolation on a tree 
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In this paper we study the properties of the Barabasi model of queueing under the hypothesis 
that the number of tasks is steadily growing in time. We map this model exactly onto an Invasion 
Percolation dynamics on a Cayley tree. This allows to recover the correct waiting time distribution 
Pvi/(t) ~ 7-~3/2 ^^ ^jjg stationary state (as observed in different realistic data) and also to characterize 
it as a sequence of causally and geometrically connected bursts of activity. We also find that the 
approach to stationarity is very slow. 
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Queueing theory [i|, 0,13 [describes a wide range of hu- 
man dynamical behaviors J, |5| . Most of traditional mod- 
els lead to exponential waiting time distributions (WTD) 
Pw{t) ~ exp(— t/tq) for the tasks in the queue. Recently, 
motivated by observations related to web browsing, email 
communications and ordinary mail correspondence [6|, 
much attention has been payed to priority driven queue- 
ing models generating power-law WTD Pw{t) ~ r~" 
for the tasks. In this paper we study a particular version 
of one of the latter kind: the Barabasi queueing model 
(BQM) [3, 01 In our version of BQM at each time step 
the task with highest random priority is always executed 
and replaced in the queue by a constant number m > 2 
of new tasks with random priorities. This process can be 
mapped exactly onto an Invasion Percolation (IP) dy- 
namics 'SI] on a Cayley tree \]Sj\ with a series of advan- 
tages. Firstly we can characterize the task list dynamics 
through the WTD at the stationary state. Secondly we 
show that its general evolution is composed by a sequence 
of geometrically and causally connected burst of activi- 
ties (task avalanches) with scale-invariant size distribu- 
tion. Thirdly, we can study the dynamics out of station- 
arity and we show that the approach to it is very slow. 
Finally, it permits to simply generalize the results in to 
the case of time-varying m. In the general BQM Q one 
starts with an initial list (i.e. queue) of no > 2 tasks. At 
every time-step t one of these tasks is executed and re- 
placed by jn{t) other new tasks. For constant 77i(i) = 1, 
the queue length remains constant. The execution rule at 
each time-step is given by fixing a random priority index 
Xi S [0, 1] for each task in the queue and then executing 
with a probability p < 1 the task with the highest prior- 
ity and with a probability (1 —p) a randomly chosen task. 
The related problem for general < p< 1 and m = 1 
has been analyzed and solved in [ll|, uM ■ I^ the purely 
extremal (i.e. when p = 1) case with a variable queue 
length, the behavior of Pw{t) differs strongly from the 
previous case. In '13] it has been studied the case in which 
at each time-step there is a probability /z < 1 to execute 
the highest priority task, while a new task is added to the 
list with another probability v < 1. For fj, = v = I the 
above case of conserved queue length is recovered. If at 
least one among /i and v is strictly smaller than 1, the list 
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FIG. 1: a) Sketch of the first four steps of IP dynamics on 
a Cayley tree with branching ratio m — 2. h) Illustration of 
a causally and geometrically connected avalanche whose size 
distribution is P{s) ~ s~ . This characterizes the stationary 
state of both IP and the task queue dynamics. 



length instead varies in time. Depending whether fi > v, 
/i = i/<lor/j,<z/ the WTD Pw{t) at the stationary 
state changes the asymptotic behavior. In particular for 
fi = V < I all tasks are executed with PwiT) ~ r"'^/^ 
with no upper cut-off, while for ^ < v, the mean queue 
length grows linearly in time, and one can show that 
asymptotically for t — > cxd all tasks with priority index 
Xi < (1 — /i/i^) are never executed staying forever in the 
queue. Instead tasks with 2:^ > (1 — m/^) ^'I'^ executed 
with a WTD coinciding with the one ioi fj, — i' < 1. In 
our version of the model the most urgent task is executed 
with probability /i = 1 and replaced in the list by a con- 
stant number m > 2 of new tasks with random priorities. 
All the features of this model can be clarified by mapping 
it into an IP dynamics on a Cayley tree. A similar map- 
ping on 1— d IP has proved to be fruitful also in the case 
of fixed queue length [12] ■ Invasion Percolation on a Cay- 
ley tree [13] is defined as follows (see Fig.[T]-a): let us take 
a Cayley tree with branching ratio m where initially only 
the top vertex site of the tree is occupied. A random num- 
ber (fitness) X, extracted from a given probability density 
function (PDF) p{x), is assigned once and forever to each 
empty site (independently of the others) . At each time- 
step the site of the growth interface dCt with the highest 
fitness is occupied. dCt is defined at each time t as the 
set of empty sites connected by a first nearest neighbor 
rule to the connected growing cluster Ct of occupied sites 
up to that time. Since for each occupied site other new 
m sites enter the growth interface, the number of sites 



respectively in Ct and in dCt at time t are respectively 
||Cf II = (t + 1) and \\dCt\\ = m + (to - l)t. Being the dy- 
namics extremal, the statistical and geometrical features 
of IP are independent on the shape oi p{x); our choice is 
to take p{x) — 1 with x € [0, 1]. 

The exact mapping between IP and our queueing 
model is done by identifying sites with tasks, fitness with 
priority index, growth interface dCt in IP with the task 
list (i.e. the queue), and finally the growing IP cluster Ct 
with the set of executed tasks up to time t. 

For our purposes we focus on the following features of 
the asymptotic stationary state of IP dynamics: 

1) The distribution (also called normalized interface his- 
togram) (j)s{x) of the fitnesses of the interface sites (i.e. 
of the tasks in the queue) , has the step- function shape 

<l>s{x) =p^^e{pc -x), 

where Pc = (m— l)/m is the ordinary percolation thresh- 
old of the Cayley tree. This implies that: (i) apart from 
a vanishing fraction (i.e. a finite number) of sites, all the 
interface sites have fitness x < Pc', (ii) since the number of 
sites in the stationary state is infinite, only those few sites 
with X > Pc can grow at each time-step. Indeed, at each 
time for the just occupied site (executed task) to > 2 
new sites (new tasks) enter the interface (queue). This 
implies that a fraction (m — l)/m of the sites entered the 
interface at any time will never be executed. Since the in- 
terface site with maximal fitness is always executed and 
the "fresh" interface sites have random fitness, asymp- 
totically only and all the sites with x > (jn — 1)/to are 
executed while the others stay forever in the interface; 

2) The cluster of occupied sites is substantially coinciding 
with the incipient percolating cluster of ordinary perco- 
lation (i.e. at occupation probability p = pc): 

3) The stationary dynamics self-organizes into a se- 
quence of spatially and causally connected avalanches 
of growth activity [ij] with a scale-invariant size dis- 
tribution P{s) ^ s '"^ independently of the value of 
TO,. Any of these avalanches (see Fig. [T]-b), say A, starts 
with the growth of a site (the initiator of A) with fitness 
X = Pc exactly, meaning that all the other interface sites 
at that time have x < Pc- Following this growth, m new 
sites/tasks (sons), geometrically connected to the initia- 
tor, enter the interface. A stops immediately if all sons 
have fitness x < Pc, and consequently another "old" in- 
terface site grows with x — Pc [due to the shape of 4>a {x)] , 
and therefore initiating a new avalanche B, i.e., A lasted 
only one step. If instead at least one of the sons of the 
initiator of A has x > Pc, then A goes on at least one 
step further as one of these sons grows. Consequently, 
other new m "descendants" (sons of a son) of the initia- 
tor of A enter the interface. Again A keeps on if at least 
one among all the remaining descendants of any gener- 
ation (called the avalanche interface) has fitness x > Pc 
otherwise the avalanche stops, and so on. 

The exponent of P{s) can be computed analytically by 
mapping the avalanche dynamics into a problem of first 
return of unbiased random walks. Let nt be the number 



of sites (tasks) with x > pc = {m — 1)/to after the i*^ 
step of an avalanche (i.e., on its interface). Since after 
the growth of one site to new sites enter the interface, we 
have the following Markovian evolution for nt > 



nt+i ^ nt + j — 1 with prob. 



Pc 



Hi-PcY (1) 



with j = 0, 1, ...,TO. I.e., nt follows an ordinary random 
walk with independent steps. As Pc — (to, — 1)/to,, the av- 
erage increment of nt in one time-step is zero (martingale 
property). Therefore [l5| the probability distribution of 
the time s for which n^ = for the first time (i.e. the 
duration of the avalanche) scales as s~^^^ at large s. A 
percolation argument can also be used to find out the 
same exponent: as the avalanche initiator has x = Pc and 
the avalanche lasts exactly for a time interval equal to 
the number of sites with x > pc connected to it in the 
positive time direction, then the avalanche size is dis- 
tributed as the finite clusters at the critical point p — pc 
in ordinary percolation on the same tree: P{s) ~ s^^'^. 
Random walk and diffusion theory arguments also per- 
mit to evaluate the stationary state WTD Pw{t) for the 
tasks with x > Pc- We follow here a similar discussion to 
fH. We can write the WTD as 



Pw{t) = 22i I dxQ{n,x)G{n,x,T) 



(2) 



n=0-'P 



where Q{n,x) is the probability that at a generic time- 
step at the stationary state we have exactly n tasks in 
the queue (i.e. sites on the IP interface) with priority 
larger than x > Pc- The quantity G(n,x,T) is instead 
the conditional probability that, always at the stationary 
state, a certain task with priority x > Pc added to the 
list at a time-step when other n tasks with priority larger 
than X are present, is executed after r time-steps. We can 
write the evolution equation for the the number nt (x) of 
tasks in the list with priority larger than x at time t. 
Similarly to Eq. ([1]) we can write for nt{x) > 1 



nt+i{x) — nt{x) + J — 1 with prob. ( . jx™ ■'(1 — x)^ , 

(3) 
where j = 0,1, ...,m. We can consequently write the mas- 
ter equation for the probability Q{n,x,t) that at time t 
there are exactly n tasks in the list with priority larger 
than X. To aim of simplicity let us write it for m = 2 for 
which Pc — 1/2. From Eq. ([3]) we can write for n > 3 

Q{n,x,t + 1) = Q{n + l,x,t)x'^ + Q{n,x,t)2x{l ~ x) 
+ Q{n-l,x,t){l-x)^ (4) 

while for n < 2 we have 

Q{2,x,t+1) = Q{3,x,t)x'^ + Q{2,x,t)2x{l~x) 

+ Q{l,x,t){l~x)^ + Q{0,x,t){l~x)'^ 

Q{l,x,t+l) == Q{2,x,t)x'^ + Q{l,x,t)2x{l-x) 

+ Q{0,x,t)2x{l~x) ; 

Q{0,x,t+l) = Q{l,x,t)x^ + Q{0,x,t)x'^ (5) 



Q{n,x) is given by the stationary solution of the above 
equations. In order to find both Q(n,x ) a nd G{n,x,T) 
we can now proceed in a similar way to [l3|. It is simple 
to show that the well-normalized stationary solution for 
x>Pc^ 1/2 of Eqs. dH) and (0 is 



Q{n,x) = 



2{x -pc) 



(l-x)' 



Q{l,x) = 2^—^{x 



for 71 > 2 (6) 
Pc) ; Q{0,x) = 2{x-pc) . 



Note that for x ^ p^ any Q{n,x) — > with the ratio 
Q{n, x)/Q{l, x) ^ 1 for any n,l > 2, i.e., the distribution 
of the number nt->ooiPc) becomes practically uniform. 

The quantity G{n, x,t) can be found by Eq. ([4]) in 
complete analogy with [ij] and [13 leading both to the 
same correct scaling behavior Pw{t) ^ r^'^/^. We refer 
here to the former as it is of simpler formulation. First of 
all we note that Eq. (|4]) , in both the continuous time and 
n = y approximation, becomes the diffusion equation: 

dtQiy, X, t) = c{x)dyQ{y, x, t) + d{x)dyQ{y, x, t) , (7) 

with c{x) = x^ and d{x) — x'^ — {1 — x)'^. Since we are 
considering x > Pc = 1/2 we have d{x) > 0, i.e., there is 
a drift to the small y (i.e. n) direction. G{n, x, r) can be 
seen as the probability that at the stationary state, fixed 
X and given that at time t — it is y = n, one has y = 
for the first at time t = t. This implies that 
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G{n,x,t) 



-dt 



dyQ{y,x,t) 



where here Q{y, x, t) is the solution of Eq. ([7]) with initial 
condition Q{y^ a;, 0) = 5{y ~ n). All this gives 



G{n,x,T) 



A/47rc(x)i 



exp 



d{x)tf 



Ac{x)t 



We now use this result and Eq. ([6|) in Eq. ([2|) to find 
Pw{t). It is simple 13j to show that for large r we have 
PwiT) ~ T^^/^. In other words each task with x > pc has 
to wait a finite portion of the avalanche duration before 
being executed. Note that all these results are completely 
independent of the integer branching factor m > 1. From 
Eq. ^ it is natural to expect to have the same result 
in the case in which at each time step m is not constant 
but fluctuates with independent fluctuations such that 
(m) > 1 and finite variance. This is the reason why our 
model share the same statistical features with that in 
[13| . In the case where (m'^\ = +00 we expect anomalous 
exponents for both P{s) and Pw{t) as the random walks 
Eqs. ([1]) and ([3]) become Levy flights as shown in 'ITJ. 

We now address the question on how fast is the ap- 
proach to stationarity in such models. Again some rigor- 
ous theoretical results for IP on a tree turn to be very 
useful to this end. We summarize here the main results 
in literature, and then propose a simple mean-field ap- 
proach showing how slow the relaxation to the right sta- 
tionary state is. In [IQ] the main exact result, adapted to 



our notation, states that the probability that at time t of 
the dynamics a task with priority smaller than (pc — e) is 
executed, vanishes exponentially fast for large i for e > 0, 
but as i~^/^ for e -^ 0+. This suggests that deviations 
from the stationary dynamics disappear as i~^". In |18| 
instead it is shown rigorously that: (i) IP on a Cayley tree 
has in the infinite time limit a unique backbone. In terms 
of the task dynamics this means that there is a unique 
infinite chain of executed task which are causally con- 
nected in the IP sense above, (ii) The minimal priority 
of the executed tasks staying on the backbone beyond 
the fc*'' generation of the Cayley tree (see Fig. [l]-a) is 
Pc(l — -2^/^) for large fc where Z is an exponential ran- 
dom variable with unitary mean. 

We now present a simple mean field argument show- 
ing this slow approach of the list dynamics to the right 
stationary state. We study the dynamics of the above in- 
troduced normalized distribution (f){x,t) of the priorities 
of the tasks in the queue (fitness histogram of interface 
sites in IP) at time t. In order to write a closed equation 
for (j){x, t) we use the Run Time Statistics (RTS) which is 
a probabilistic method introduced to describe IP and re- 
lated dynamics, and evaluate the statistical weight of all 
different "histories" of the dynamics (i.e. paths in the re- 
alization space) |19l[20l[2H. Let h{x, t)dx be the number 
of tasks in the queue at time t with priority in [a;, a: + dx\ 
in a single realization. We can write rigorously: 



h{x^ t -|- 1) = h{x^ t) — m(x, t + 1) + m . 



(8) 



where m{x, t) is the PDF of the priority of the executed 
task at time t conditional to the whole past history. By 
calling pi{x,t) the PDF of the priority of the i*^ task 
in the queue at time t conditional to the same past his- 
tory, and assuming that the executed task at that time 
is the j*'', a good approximation for m{x,t + 1) [20] is 
m{x,t+ 1) = 7i-^Pj(a;,i)nf(%) [Jo dypz{y,t)], where 
Hi^) = /o dxpj{x,t)Y\^^^^^ [J^ dyp^{y,t)] is the proba- 
bility of selecting j conditional to the past history. We 
now average Eq. ([5]) over all the possible realizations of 
the dynamics up to time (t + 1) using the symbol {■)^ii 
for this average. By definition we have {h{x, t + l))j 1 x — 
(m -l){t+ l)(j){x, t + 1) and {h{x, t))^_^_^ = {h{x, t))^ = 
[m — l)tip{x,t). In order to take the same average of 
m{x,t + l) note that, if ^(iq, ii, ...,?t-i, it) is a function 
of the queue history up to time (t+1) identified by the se- 
quence of executed tasks {io,zi, ...,it-i,it}, by the rules 
of conditional probability, we can write 

(yl(io, «!,..., «t))t+i = / ^ n-j(t)A{io,ii,...,it-i,j)) ■ 



We therefore have 



.t) 



I dCt r ^.x 

{m{x,t + l))^^^ = i^ Pj{x,t)W I dyp^{y, 
\jedCt i{^j) L-'o 

Considering that by definition {pj{x,t))^ = (j>{x,t), we 
now introduce the mean field approximation consisting 



in replacing the average of the above products of pi (x, t) Note that Pc = (m — l)/m. Moreover in the x region were 
with the products of the averages, i.e., e = {1 — ip) <^ ^/[{^ ~ 1)^] it is simple to show that the 

following approximation holds 



{m{x, t + l))j_,_]^ = {m~l)t(j){x, t) 



dy(j){y,t) 



(m-l)t-l 



(9) 



dtt{x,t) = -e{x,t) + 



We can now write the mean-field equation for (t>{x, t) as 



m{\ — x) 
(m-l)(^ + l) 



(14) 



{x,t + l) = 



t + l 



{x,t)ll 



dy(f){y,t) 



- (m-i)t-i~j whose solution is ip{x,t) = 1 — e(.x,t) with 



(m-l)(t + l) 



(10) 



This strong decorrelating approximation is expected to 
lead to a faster relaxation to stationarity than the actual 
one. We show however that, even in this approximation, 
the stationary state is the right one and the approach to 
it is power law. Integrating both sides of Eq. (fTU)) . taking 
the continuous time limit and i 3> 1 we get 



dtip{x,t) 



-1 



t + l 



V" 



1 



-V' 



(m-l)t 



mx 



(11) 



where ipixjt) = J^ dx' 4>{x' ,t) is the cumulative average 
priority distribution, and we have assumed -0(0, i) = 
at all t. The initial condition for Eq. (fTTj) is ipi^i^) = x- 
Since (j){x,t) is a normalized PDF, we have ■ip{x,t) > 0, 
non-decreasing in x and ^p{l,t) — 1. 

In the X region were (1 — '0) 3> l/[{rn — l)i] we can 
approximate Eq. (Ill|) simply with 



9t0(x,<) 



1 



^. 



t+l \' m- 1 
which leads to the solution for sufficiently large t 

1 



'ip{x,t)= 



m — \ 



1 



1 

nit 



for X < 



1 
rri^t 



(12) 



(13) 



e(x,t) = 



m{l — x) 
(m-l)(t + l) 



1+0 



(15) 



when X ^ {ni — Vj/m. All this means that 



cj){x,t) 



9{pc - x) 



Pc 



ix,t) 



with 6(j){x,t) ^ 1/t. Therefore even in this mean field 
approximation, for which we expect a faster relaxation, 
deviations from it vanish as slowly as 1/t. 

In conclusion, we have shown a way to analytically 
compute all the main features of the Barabasi model of 
human dynamics with time-increasing queue length. This 
is done by using Invasion Percolation on a Cayley tree 
and random walk theory. We believe that the approach 
we introduced, allows us to describe quantitatively two 
intuitive features of tasks queues. The first feature is that 
some tasks seem to remain indefinitely before being pro- 
cessed; secondly we recover naturally the fact that in real 
world execution of a task has often the effect to generate 
an avalanche of new tasks. Through our approach one 
can study both the stationary state dynamics and the 
approach to it. This shows that both are characterized 
by temporal power laws as typical for extremal dynamics 
in quenched disorder [13, 120, ^M ■ 
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